Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: Add AlignedBytes types #19308

Merged
merged 3 commits into from
Oct 23, 2024

Conversation

coastalwhite
Copy link
Collaborator

This adds types that arrow NativeTypes can cast to which can help to reduce monomorphizations. This also adds the support to SharedStorage to keep use a type with a stricter size and alignment constraint as BackingStore without memcopying.

fyi @orlp

@github-actions github-actions bot added internal An internal refactor or improvement python Related to Python Polars rust Related to Rust Polars labels Oct 18, 2024
Copy link

codecov bot commented Oct 18, 2024

Codecov Report

Attention: Patch coverage is 22.22222% with 105 lines in your changes missing coverage. Please review.

Project coverage is 80.01%. Comparing base (01a4e06) to head (e387dec).
Report is 12 commits behind head on main.

Files with missing lines Patch % Lines
crates/polars-arrow/src/types/aligned_bytes.rs 0.00% 57 Missing ⚠️
crates/polars-arrow/src/storage.rs 37.66% 48 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main   #19308      +/-   ##
==========================================
- Coverage   80.03%   80.01%   -0.03%     
==========================================
  Files        1528     1532       +4     
  Lines      209819   210162     +343     
  Branches     2419     2434      +15     
==========================================
+ Hits       167932   168159     +227     
- Misses      41336    41448     +112     
- Partials      551      555       +4     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Collaborator

@orlp orlp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just 'requesting changes' so I can take a good look monday without @ritchie46 merging this in the meantime 😅

coastalwhite and others added 3 commits October 21, 2024 15:17
This adds types that arrow `NativeType`s can cast to which can help to reduce
monomorphizations. This also adds the support to `SharedStorage` to keep use a
type with a stricter size and alignment constraint as `BackingStore` without
memcopying.

fyi @orlp
@orlp orlp force-pushed the refactor/size-alignment-types branch from e387dec to 44f0690 Compare October 21, 2024 13:20
@coastalwhite
Copy link
Collaborator Author

@orlp are there still objections to this getting merged?

@orlp
Copy link
Collaborator

orlp commented Oct 23, 2024

@coastalwhite Nope, I pushed my changes and separated the stuff I wanted to separate into a different PR.

@ritchie46 ritchie46 merged commit fc8eec2 into pola-rs:main Oct 23, 2024
17 of 20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
internal An internal refactor or improvement python Related to Python Polars rust Related to Rust Polars
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants